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BACKGROUND OF THE INVENTION 

[00 1 ] Negotiable transactions typically involve the following parties: a payor, a payee, 
and a corresponding financial institution such as a bank or other type of 
intermediary such as a clearing-house. A negotiable document or instrument 
issued as a form of payment, for instance a check, is used by the financial 
institution to transfer funds between accounts, typically to credit the payee's 
account and debit the payor's account. Information about all parties involved in 
the transaction is contained in the negotiable document. 

[002] Traditionally, the payor's handwritten signature has been used as an indicia of the 
authenticity of the document and the information contained therein. The 
underlying reasons for this include: (1) a signature is assumed to be difficult to 
forge, thereby serving as proof that the signor is cognizant of and in agreement 
with the contents of the document, particularly the amount and identity of the 
payee; (2) a signature is assumed to be non-reusable-it is thought of as being an 
integral or inseparable part of the document and cannot easily be transferred to, or 
reproduced onto, another document; (3) once signed, it is assumed that the 
document cannot be modified or altered; and (4) it is generally assumed that the 
signature cannot be repudiated. In reality, these assumptions are generally false. 
Unless a financial clerk has access to a large and extremely fast graphical database 
of payor signatures, it is very difficult for the clerk to reliably detect forged 
signatures when processing checks. Nor have electronic systems progressed to the 
point where they can accurately or consistently identify forged signatures. Even if 
a signature is authentic, it is not very difficult to alter documents after being 



signed, particularly the monetary value of the document or the identity of the 
payee. Moreover, the entire check may be fraudulently produced such that no 
alterations or additions to the negotiable document may be readily discerned. 

[003] Check fraud has been considered to be the third largest type of banking fraud, 
estimated to be about fifty million dollars per year in Canada according to a 
KPMG Fraud Survey Report. In the United States, such fraud is estimated to 
cause financial loss of over ten billion dollars per year. Financial institutions and 
corporations spend a great deal of time, effort and money in preventing or 
recovering from fraudulent checks. With the recent proliferation and affordability 
of computer hardware such as document scanners, magnetic-ink laser printers, etc., 
check fraud is expected to reach new limits. 

[004] To date, various attempts have been made to protect checks from fraudulent 
interference of the type described above. One method is to use mechanical 
amount-encoding machines which create perforations in the document reflecting 
the monetary value thereof. The perforations in the document define the profile of 
an associated character or digit. However, a check forger can still scan the payor's 
signature and reprint the check with a new amount using the same type of readily 
available mechanical encoding machine to apply the perforations. This method 
also has a significant drawback due to the amount of time and human labor 
required to produce checks, and thus may be considered expensive or impractical 
for certain organizations. 

[005] Another prior art check protection method uses electronic means to print the 
numerical amount of the check using special fonts, supposedly difficult to 



reproduce. A negotiable document is considered unforged if it contains the special 
font and if the characters representing the monetary value of the check are not 
tampered with. Due to the fact that these characters are difficult to produce 
without a machine or a computer, the check is assumed to be protected. Given the 
ready availability of high quality scanners and printers, it is, however, possible that 
the check forger will copy one of the characters printed on the check and paste it as 
the most significant digit of the amount thereby increasing the monetary amount of 
the transaction. As such, after the forger reprints the check with a new most 
significant digit, the check will meet the criteria of having the special fonts 
defining the numerical amount, whereby the forged document may be interpreted 
as a valid check. 

Other types of check validation techniques are disclosed in U.S. Pat. No. 
4,637,634 to Troy et al. This reference discloses a sales promotional check which 
consists of a top check half, distributed through direct mail, flyers, newspaper 
inserts, etc., and a bottom check half which may be obtained, for example, when a 
stipulated purchase of goods or services has been made by the intended payee. If 
information on the top and bottom halves match, the check becomes a negotiable 
instrument. For validation purposes, the bottom half is provided with at least one 
code number that is generated, using a complex mathematical formula, from the 
check number, the register number, and the script dollar amount, all of which are 
present on the face of the check in human-readable form. The validation code 
number appears as a bar code or other machine readable code on the face of the 
check. For verification purposes, the same code number appears underneath an 



opaque "rub-off ' overlay which, if tampered with, renders the check void. To 
verify the check, the opaque overlay is removed to reveal the concealed code 
number which is then compared against the machine readable code number printed 
on the check. This system is still prone to tampering because one could alter the 
amount of the check without tampering with the code numbers. To avoid this 
situation, the check must be compared against a predefined list, i.e. an electronic 
file, listing all of the payor's checks to verify the original amount. Thus, this 
system may therefore be impractical for most organizations and is incompatible 
with current check clearing procedures. 
[007] There remains a need for securing information associated with negotiable 

documents from being fraudulently tampered with. Moreover, there remains a 
need for such a security system which is compatible with current check printing 
systems and check clearing systems, and which generates checks that are 
essentially unforgeable. 
ft SUMMARY OF THE INVENTION 

[008] Apparatus, methods, and articles of manufacture consistent with the present 
invention provide a check validation scheme wherein a payor's signature is 
digitized, encrypted and embedded on the front of the check using glyphs. Later, 
when the payor seeks to convert a blank check into a negotiable instrument, he/she 
fills out the check and signs it. When the check is presented for payment, a clerk 
using a decoding device, decodes and decrypts the digitized signature such that a 
human-readable image of the digitized signature can be seen on a screen for 
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comparison with the payor's scripted signature. If the two signatures are identical, 
the check is honored. 
[009] Apparatus, methods, and articles of manufacture consistent with a second 

embodiment of the present invention provides a check validation scheme wherein 
the payor's signature, payee, amount, date, magnetic ink character recognition 
(MICR) line and memo is digitized, encrypted and embedded on the front of the 
check using glyphs when the check is created. When the check is presented to a 
bank for payment, a teller using a decoding device, decodes and decrypts the 
digitized information such that a human-readable image of the payee, amount and 
payor signature can be seen on a screen for comparison with the scripted 
information on the face of the check. If the information is identical, the check is 
honored. 

[010] Additional objects and advantages of the invention will be set forth in part in the 
description which follows, and in part will be clear from the description or will be 
learned by practice of the invention. The objects and advantages of the invention 
will be realized and attained by means of the elements and combinations 
particularly pointed out in the appended claims. It is understood that both the 
foregoing general description and the following detailed description are exemplary 
and explanatory only and are not restrictive of the invention, as claimed. 
BRIEF DESCRIPTION OF THE DRAWINGS 

[Oil] The accompanying drawings, which are incorporated in and constitute a part of 
this specification, illustrate an embodiment of the invention and, together with the 
description, serve to explain the principles of the invention. 



[012] Fig, 1 illustrates an overview of the properties of glyph marks and codes 

embodied in the glyph marks; 
[013] Fig. 2 illustrates an embodiment of an image combining graphics and glyphs 

consistent with the present invention; 
[014] Fig. 3 illustrates an enlarged view of a portion of the image illustrated in Fig. 2; 
[0 1 5] Fig. 4 illustrates an image of a pictorial comprising glyphtones consistent with 

the principles of the present invention; 
[016] Fig. 5 illustrates a system for reading an image having embedded data, decoding 

the embedded data in the image, and developing human-sensible information based 

on the decoded embedded data; 
[017] Fig. 6 illustrates a logical configuration of elements consistent with principles of 

the present invention; 

[018] Fig. 7 illustrates another embodiment of a system consistent with the principles 
of the invention; 

[019] Fig. 8 is a diagram illustrating the superimposition of embedded information 

consistent with the principles of the invention; 
[020] Fig. 9 is a block diagram illustrating one embodiment of a lens apparatus 

consistent with the principles of the invention; , 
[021] Fig. 10 is a cutaway side view of the lens apparatus shown in Fig. 9; 
[022] Fig. 1 1 illustrates an example of a substrate, an overlay image, and the substrate 

overlaid with the overlay image as seen through the lens viewport illustrated in 

Fig. 9 and Fig. 10; 



[023] Fig. 1 2 is a detailed flow diagram of the process for creating a glyphcheck in 
accordance with one embodiment of the present invention; and 

[024] Fig. 13 illustrates another example of a substrate, an overlay image, and the 
substrate overlaid with the overlay image as seen through the lens viewport 
illustrated in Fig. 9 and Fig. 10. 

DETAILED DESCRIPTION OF THE INVENTION 

[025] Reference will now be made in detail to embodiments of the invention, examples 
of which are illustrated in the accompanying drawings. Apparatus, methods, and 
articles of manufacture consistent with the present invention provide a check 
validation scheme wherein a payor's signature is digitized, encrypted and 
embedded on the front of the check using glyphs. 

[026] Fig. 1 illustrates glyph marks and codes embodied in the glyph marks. Glyph 
marks are typically implemented as a fine pattern on a substrate, such as glyph 
marks 21 on substrate 24. Glyph marks are not easily resolved by the unaided 
human eye. Thus, glyph marks typically appear to the unaided eye as having a 
uniform gray scale appearance or texture, as illustrated by glyph marks 21 in Fig. 
1. 

[027] Enlarged area 23 shows an area of glyph marks 2 1 . Glyph marks 2 1 are 

comprised of elongated slash-like marks, such as glyph 22, and are typically 
distributed evenly widthwise and lengthwise on a lattice of glyph center points to 
form a rectangular pattern of glyphs. Glyphs are usually tilted backward or 
forward, representing the binary values of "0" or "1," respectively. For example, 
glyphs may be tilted at +45° or -45° with respect to the longitudinal dimension of 
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substrate 24. Using these binary properties, the glyph marks can be used to create 
a series of glyph marks representing 0 r s and l r s embodying a particular coding 
system. 

[028] The glyph marks of enlarged area 23 can be read by an image capture device. 
The captured image of glyph marks can then be decoded into 0's and l's by a 
decoding device. Decoding the glyphs into 0's and l's creates a glyph code pattern 
25. The 0's and l's of glyph code pattern 25 can be further decoded in accordance 
with the particular coding system used to create glyph marks 21. Additional 
processing might be necessary in the decoding stage to resolve ambiguities created 
by distorted or erased glyphs. 

[029] Glyph marks can be implemented in many ways. Apparatus and methods 
consistent with the invention read and decode various types of glyph code 
implementations. For example, glyphs can be combined with graphics or may be 
used as halftones for creating images. 

[030] Fig. 2 illustrates an embodiment of an image 210 combining graphics and glyphs 
consistent with the present invention. In this particular embodiment, the graphics 
comprise user interface icons. Each icon comprises a graphic overlaid on glyphs. 
The glyphs form an address carpet. The glyph address carpet establishes a unique 
address space of positions and orientations for the image by appropriate coding of 
the glyph values. 

[03 1] Fig. 3 illustrates an enlarged view of a portion of image 210 illustrated in Fig. 2. 
More particularly, portion 212 illustrates the Lab.avi icon overlaying a portion of 



the address carpet, which unambiguously identifies the icon location and 
orientation. 

[032] Fig. 4 illustrates an image of a pictorial comprising glyphtones consistent with 

the present invention. Glyphtones are halftone cells having area-modulated glyphs 
that can be used to create halftone images incorporating a glyph code. As shown 
in Figs. 1-4, glyphs and glyphtones allow a user to discretely embed machine- 
readable data in any pictorial or graphical image. Using glyphtones to encode the 
user-inputted information is included for illustrative purposes. Barcodes and other 
machine-readable codes, including ID-barcodes, 2D barcodes adhering to the 
PDF417 standard, or other 2D symbologies, may also be used without departing 
from the spirit and scope of the present invention. 
[033] Fig. 5 illustrates a system 500 for reading an image having embedded data, 



f || decoding the embedded data in the image, and developing human-sensible 



information based on the decoded embedded data. As shown, system 500 is 
comprised of image capture device 470, decoder 472, information generator 474 
and information output 476. In operation, image capture 470 reads substrate 468 
to capture an image having embedded data. In one embodiment, image capture 
device 470 is capable of scanning substrate 468 using two different resolutions: a 
low-resolution color scan of the substrate for display purposes; and a high- 
resolution monochrome scan of the DataGlyph region to maximize the accuracy of 
the captured data. Decoder 472 processes the high-resolution image, extracts data 
from the DataGlyph, and decodes the embedded data in the captured image. 
Information generator 474 develops human-sensible information based on the 
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decoded embedded data, and outputs the information to information output 476, 
which represents one or more information output devices. Information generator 
474 may additionally scale rendered output information to a resolution appropriate 
for output 476. The human-sensible information may be visual information 
decoded from the surface of substrate 468 (e.g., handwritten signature, amount, 
date, payee, payor, MICR line etc.) and additionally or alternatively may comprise 
tactile, audible, or other human-sensible information. 

Fig. 6 is a block diagram illustrating a logical configuration of elements in 
accordance with principles consistent with the invention. An image capture device 
70 captures an image from a substrate 68. Substrate 68 has embedded data, such 
as glyphs embodied thereon. Image capture device 70 transfers the captured 
substrate image to a decoder 72 and an image generator 74. In one embodiment, 
substrate 68 is a personal check. In the present invention, a personal check may 
either be a handwritten or computer-generated check with embedded data. The 
embedded data on substrate 68 comprises a digitized image of any combination of 
the following: payor's signature, payee, amount, date, MICR line and memo. 
Decoder 72 analyzes the embedded data in the captured substrate image to decode 
the encrypted digital information. These results are transferred to image generator 
74 for further processing. Image generator 74 processes the results from decoder 
72 and the captured substrate image from image capture device 70. In one 
embodiment, image generator 74 retrieves an image of substrate 68 that is the 
same size as the footprint of display 76 and corresponds to the area of substrate 68 
directly under the footprint of display 76. Because display 76 is aligned with 
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substrate 68, observer 78 looking at display 76 is given the illusion of looking 
directly onto substrate 68. Image generator 74 may also add information to the 
image, or alter the retrieved image before sending it to display 76. 
[035] The image sent to display 76 may be generated by image generator 74 in many 
ways. For example, image generator 74 may merely pass on the image captured 
by image capture 70, or a representation of the image captured by image capture 
70. A bitmap representation of the entire substrate 68 could be stored locally in 
image generator 74 or on a remote device, such as a device on a network. In one 
embodiment, in response to receiving codes from decoder 72, image generator 74 
retrieves an area corresponding to the codes from the bitmap representation, and 
forwards the area representation to display 76 for display to a user. The area 
representation retrieved by image generator 74 may be the same size as the image 
captured by image capture 70, or may be an extended view, including not only a 
representation of the captured area, but also a representation of an area outside the 
captured area. The extended view approach only requires image capture 70 to be 
as large as is necessary to capture an image from substrate 68 that is large enough 
for the codes to be derived, yet still provides a perception to the user of seeing a 
larger area. 

[036] Fig. 7 is a block diagram illustrating an embodiment of a system consistent with 
the principles of the invention. A substrate 89 having embedded data thereon is 
positioned below a semitransparent mirror 82. An image from substrate 89 is 
captured by an image capture device 80. Image capture device 80 sends the 
captured image to a decoder 88, which decodes the image and determines codes 
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from the captured image. Decoder 88 sends the codes to an image generator 84. 
Image generator 84 processes the codes, creates and/or retrieves image information 
based on the codes, and sends the image information to semitransparent mirror 82. 

[037] An observer 86 looking down onto semitransparent mirror 82 sees the image 

generated by image generator 84 overlaid on the image from substrate 89. In this 
way, the overlaid information can be dynamically updated and registered with 
information on substrate 89 based on the decoded image captured by image 
capture device 80, In an alternative embodiment, image capture 80 receives the 
substrate image reflected from semitransparent mirror 82. 

[038] In each of the systems of Fig. 5, Fig. 6 and Fig. 7, the elements may send 

information to and receive information from network devices. This allows the 
elements to interact with devices on a network. For example, programs and data 
may be sent to the elements from network devices, and the devices may send 
information to the devices on networks. While these figures all depict the use of a 
network to communicate information, it is important to realize that the information 
may instead be resident on a standalone computer and therefore not rely on a 
network to operate. 

[039] Fig. 8 is a diagram illustrating the process of decoding and displaying 

information consistent with the principles of the invention. As shown in Fig. 8, 
substrate 364 has embedded code embodied thereon (shown as light gray 
background), and may have images, such as a triangle and crosshair arrow. The 
embedded code embodies a code system from which additional content from 
substrate 364 can be determined. In Fig. 8, the embedded code may represent 
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image information 366 in the form of a second triangle and crosshair arrow. An 
image capture device captures a portion of substrate 364, to thereby capture an 
image of a portion of the embedded code embodied thereon. The embedded code 
is decoded to determine its human-sensible contents, and the orientation of 
substrate 364, represented by the crosshair arrow on substrate 364. The decoded 
code is used to construct image information 366. The content and orientation 
information decoded from the embedded code on substrate 364 are then used to 
visually superimpose image information 366 on substrate 364 to form a composite 
image 368. Instead of superimposing image information 366 on substrate 364, the 
embedded code may alternatively be displayed separately from the image of 
substrate 364. 

[040] Since image information 366 is in machine-readable form, a human being cannot 
easily decipher it. However, anyone with the appropriate decoder may decode the 

£ encoded information. To further enhance security, two cryptographic techniques 

0 

W> may be deployed. First, all or part of data substrate 364 may be encrypted. To 

decrypt the data, an appropriate cryptographic key is required, thus restricting 
information access to authorized parties (e.g. a clerk). Second, all or part of data 
substrate 364 may be digitally signed. The digital signature provides 
cryptographic assurance that data substrate 364 has not been altered, and was 
produced by an authorized key holder (e.g. a bank). Cryptographic techniques, 
including public key cryptography (PKC) as disclosed in U.S. Patent No 4,405,829 
(which is hereby incorporated by reference), are commonly known by those skilled 
in the art. 
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[041] Fig. 9 is a block diagram illustrating an embodiment of a lens apparatus 

consistent with the principles of the invention. Lens apparatus 328 is comprised of 
lens viewport 334, which is supported by support arm 330. A viewer looking 
down through lens viewport 334 observes substrate 332, which has embedded code 
embodied thereon. A camera (not shown) captures an image of substrate 332. The 
image is sent to a computer (not shown), which decodes the embedded code on 
substrate 332 appearing under lens viewport 334, the orientation of substrate 332 
under lens viewport 334, and the label code, if any, in the embedded code on 
substrate 332. Based on the label, x,y location and orientation of substrate 332, the 
computer generates overlay image information which is displayed in lens viewport 
334 in such a way that the generated image information represents human-sensible 
text, patterns or symbols. 

[042] Fig. 10 is a cutaway side view of the lens apparatus shown in Fig. 9. Lens 
apparatus 328 further comprises camera 392, display 394, lamp 396, display 
controller 398, computer 400 and semitransparent mirror 402. Lamp 396 
illuminates substrate 332 (not shown). Camera 392, which corresponds to image 
capture devices 70 and 80 illustrated in Fig. 6 and Fig. 7, respectively, captures an 
image of the substrate, and transmits the image to computer 400. Computer 400 
performs the function of decoders 72 and 82 illustrated in Fig. 6 and Fig. 7, 
respectively. Computer 400, in combination with display controller 398 and 
display 394, performs a function most similar to image generator 84 illustrated in 
Fig. 7 because the generated image is reflected off semitransparent mirror 402. 
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[043] Computer 400 decodes the embedded data in the captured image to construct 
human-sensible image information (e.g., a payor's scripted signature) 
representative of the embedded code. Computer 400 may also decode the 
embedded data in the captured image to determine the orientation of substrate 332 
under lens viewport 334, and the label code, if any, in the embedded code of the 
captured image. From this information, computer 400 generates the overlay image 
information, which is sent to display controller 398. Display controller 398 sends 
the overlay image information to display 394. Display 394 generates an overlay 
image based on the overlay image information from display controller 398. 
Observer 390 looking through viewport 334 sees substrate 332 through 
semitransparent mirror 402 overlaid with the overlay image information generated 
by image generator 394. 

[044] Fig. 1 1 illustrates an example of a substrate 480 (Fig. 1 la), an overlay image 
(Fig. 1 lb), and the substrate overlaid with the overlay image (Fig. 1 1c) as seen 
through the lens viewport illustrated in Fig. 9 and Fig. 10. Substrate 480 (a 
glyphcheck) as shown in Fig. 11c appears to be identical to a prior art third-party 
check. It is only after substrate 480 is viewed through the lens viewport, that its 
true character as a glyphcheck with embedded data is revealed. The substrate 480 
is comprised of a completed third party check drawn on a payor's account and 
embedded data. In this case, substrate 480 is comprised of at least a payor 
identification 484, bank address 486, and payor signature 488. In one 
embodiment, either or both sides of substrate 480 are covered entirely with 
embedded data. Substrate 480 may alternatively be comprised of one or more 
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small areas of embedded data. For example, the background, the text, or both may 
be comprised of embedded data, or all three may be comprised of embedded data. 
Similarly, portions of the background of substrate 480 (e.g., the portion behind 
bank address 486 or the portion behind the payor address 484) may comprise 
embedded data. Embedded data may also be appended to substrate 480 through 
the use of an adhesive sticker. 
[045] Referring now to Fig. 12, there is shown a process for creating a third-party 
check in accordance with the present invention will now be described. The 

^ process begins in step 1210 when a user (or payor) selects the data to encode. The 

Hi 

user may encode all or a portion of the data included on the front of a third-party 
J: check. More specifically, the user may encode: payor's signature, payee, amount, 

Cfl date, MICR line and memo. For handwritten checks, the user may encode a 

^ computer graphic of the user's signature or information validating the MICR line. 

^ For computer-generated checks, the user may additionally choose to encode 

2 information validating the payee, payor, amount, date and memo. If the user 

decides to only encode the payor's signature, processing may immediately flow to 
step 1230 where the system allows the user to select the access restrictions and 
then output one or more pre-printed glyphchecks (explained below). It is 
important to note that if the user elects to encode information in addition to the 
payor's signature, the encoded data will vary from one check to the next. 
[046] Once the user selects the data to encode, processing flows to step 1220, where the 
user selects the placement of the encoded data. As previously stated, the encoded 
data may be limited to one or more portions of the check, or it may be printed on 
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the entire check. For example, the user may limit the location of the encoded data 
to the front of the check, the back of the check, or to one or more predefined 
locations on either the front or back. Given the nature of glyphs and glyphtones 
(including the capability of using color) it is possible to print everything, including 
pictures and text using glyphs. However, the user or the bank holding the account 
may wish to limit the location of the embedded data. Consequently, the system 
gives the user the opportunity to select the placement of the encoded data. 
[047] Once the user selects the placement location for the embedded data, processing 
J flows to step 1230 where the user is given an opportunity to select the level of 

J access to the data. In other words, the user may tightly limit access to the data, or 

|:; the user may provide unfettered access to the unencrypted data. More specifically, 

m cryptography may be used to assure the integrity of the data encoded in the check, 

W and/or provide access controls to the encoded information. The computer graphic 

W; of the payor's signature may be encrypted, such that only holders of the appropriate 

?f cryptographic key will be able to view it. The encoded information may also be 

digitally signed, such that its integrity may be cryptographically inspected. It is 
important to note that a digital signature can be encoded, even if the information 
signed is not encoded. For example, the user may encode the digital signature of 
the MICR line, but not the MICR line itself. The MICR line may be read directly 
off the check during verification, and compared with the encoded digital signature. 
The information being digitally signed may also be concatenated such that a single 
digital signature may be used to validate its integrity. 
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[048] Once the user selects the data access limits, processing flows to step 1240 where 
the system prints one or more checks for use by the payor. After the check is 
printed, the payor may use the check as desired. For handwritten checks, the payor 
may manually write information on the face of the check, even at the risk of 
possibly overwriting the embedded information. Glyph codes, as known by those 
skilled in the art, are capable of being decoded even though some of the marks 
may be occluded, or not readable. 

[049] To retrieve the embedded code from substrate 480, a user first places substrate 
480 under lens viewport 334 and camera 392 captures the image appearing under 
lens viewport 334 and transmits the image to computer 400. Computer 400 (as 
shown in FIG. 10) decodes the embedded data in the captured image from 
substrate 480 to construct the human-sensible image information representative of 
the embedded code on substrate appearing under lens viewport 334. Computer 
400 may also decode the embedded data in the captured image to determine the 
orientation of substrate 480 under lens viewport 334, and the label code, if any, in 
the embedded code of the captured image. 

[050] From this information, computer 400 generates overlay image information 482, 
which is sent to display controller 398. Display controller 398 sends overlay 
image information 482 to display 394. Display 394 generates overlay image 
information 482, which is reflected off semitransparent mirror 402 through lens 
viewport 334. Observer 390 looking through viewport 334 sees substrate 332 
through semitransparent mirror 402 overlaid with overlay image information 482 
generated by image generator 394. In Fig. 1 lc, the overlay image information 482 



19 



is a scripted signature overlaid on the third-party check. A financial clerk 
comparing the two signatures can now determine, without accessing any external 
databases or manual data stores, whether the signature written on the check is 
authentic. 

[051] Fig. 13 illustrates another example of a substrate, an overlay image, and the 
substrate overlaid with the overlay image as seen through the lens viewport 
illustrated in Fig. 9 and Fig. 10. More particularly, Fig. 13 illustrates how the 
system may respond when the user moves substrate 430 under lens viewport 334. 
In this example, substrate 430 comprises a third-party check made out to "Krispy 
Kreme" for "twenty-six" dollars. The memo indicates that the check is for 
"Donuts". Substrate 430 also includes embedded data embodied thereon (not 
shown). In this embodiment, it is envisioned that the payor has encoded 
information on the payee, amount, memo, and signature when the check was 
created. When the user (e.g., bank teller) moves substrate 430 so that the payee 
(i.e., "Pay to the Order of) is under lens viewport 334, camera 400 captures an 
image of the substrate area under lens viewport 334. Computer 400 decodes the 
embedded data in the captured image from substrate 430 and compares the 
decoded data with the handwritten data on the surface of the third-party check. 
When computer 400 determines that the two terms are identical, it generates 
overlay information "Payee not tampered with," sends the information to display 
controller 398, and the information is reflected off semitransparent mirror 402. A 
user looking through lens viewport 334 sees the payee information overlaid with 
overlay image information "Payee not tampered with," as illustrated in the upper 
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right of Fig. 13. When the user moves substrate 430 so that the memo appears 
under lens viewport 334, camera 392 captures an image of the new area under lens 
viewport 334. Computer 400 decodes the embedded data in the captured image 
from substrate 430 and compares the decoded data with the handwritten data on 
the surface of the third-party check. When computer 400 determines that the two 
terms are identical, it generates overlay information "Memo not tampered with," 
sends the information to display controller 398, and the information is reflected off 
semitransparent mirror 402. A user looking through lens viewport 334 sees the 
memo information overlaid with overlay image information "Memo not tampered 
with," as illustrated in the lower right of 14. Thus, as the user moves substrate 
430, the overlay image information is dynamically modified to appear in lens 
viewport 334. 

[052] Superimposing the overlay image with the substrate requires a precise 

determination of the orientation of the substrate with respect to the image capture 
device. To determine the orientation angle of the substrate relative to the image 
capture device, computer 400 resolves the angle between 0° and 360°. Orientation 
determination routines are commonly known by those skilled in the art. Therefore, 
an explanation of them will not be repeated here for the sake of brevity. 

[053] Computer 400 decodes address information encoded in the glyphs by analyzing 
the captured image area in two steps. Ideally, in the systems shown and described 
with respect to Figs. 6, Fig. 7 and 10, image capture devices 70, 80, and 392, 
respectively, capture an area of a substrate that is angularly aligned as shown in the 
pattern of bits shown in 22. In reality, however, the substrate and image capture 



21 



device may not be aligned to one another. Thus, the relative angle between the 
two could be oriented anywhere from 0° to 359°. Therefore, computer 400 must 
first determine the orientation of the image as part of decoding and interpreting the 
address information. 

[054] In the previous description, operation of the present system was described as if 
manual operations were performed by a human operator. It must be understood 
that no such involvement of a human operator is necessary or even desirable in the 
present invention. The operations described herein are machine operations that 
may alternatively be performed in conjunction with a human operator or user who 
interacts with the computer. The machines used for performing the operation of 
the present invention include general-purpose digital computers or other similar 
computing devices. 

[055] The orientation of the image is determined by analyzing the captured image. 

This process is called disambiguation. One method of disambiguation is described 
in U.S. Patent Application No. 09/454,526, entitled METHOD AND 
APPARATUS FOR DECODING ANGULAR ORIENTATION OF LATTICE 
CODES, filed December 6, 1999, which is hereby incorporated by reference. 

[056] Other embodiments of the invention will be apparent to those skilled in the art 
from consideration of the specification and practice of the disclosed embodiments. 
The specification and examples are exemplary only, and the true scope and spirit 
of the invention is defined by the following claims and their equivalents. 
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